On the Storage Capacity of Nonlinear Neural Networks
نویسندگان
چکیده
منابع مشابه
On the Storage Capacity of Nonlinear Neural Networks
We consider the Hopfield associative memory for storing m patterns xi(r) in { - 1, + 1}(n), r = 1, em leader,m. The weights are given by the scalar product model w(ij)=(m/n)G,i not equal j,w(ii) identical with 0, where G:R --> R is some nonlinear function, like G(x) z.tbnd6; Sgn(x), which is used in hardware implementation of associative memories. We give a rigorous lower bound for the memory s...
متن کاملOn the stability, storage capacity, and design of nonlinear continuous neural networks
The s t a b i l i t y , c a p a c i t y , and design o f a n o n l i n e a r , continuous neural netwark are analyzed. S u f f i c i e n t c o n d i t i o n s f o r e x i s t e n c e and asymptotic s t a b i l i t y o f t h e network's equi-l i b r i a are reduced t o a s e t o f piecewise l i n e a r i n e q u a l i t y r e 1 a t i ons whi ch can be s o l ved by a feedforward b i nary network,...
متن کاملStorage capacity of two-dimensional neural networks.
We investigate the maximum number of embedded patterns in the two-dimensional Hopfield model. The grand state energies of two specific network states, namely, the energies of the pure-ferromagnetic state and the state of specific one stored pattern are calculated exactly in terms of the correlation function of the ferromagnetic Ising model. We also investigate the energy landscape around them a...
متن کاملAn Influence of Nonlinearities to Storage Capacity of Neural Networks
The more realistic neural soma and synaptic nonlinear relations and an alternative mean field theory (MFT) approach relevant for strongly interconnected systems as a cortical matter are considered. The general procedure of averaging the quenched random states in the fully-connected networks for MFT, as usually, is based on the Boltzmann Machine learning. But this approach requires an unrealisti...
متن کاملOptimal storage capacity of neural networks at finite temperatures
Gardner's analysis of the optimal storage capacity of neural networks is extended to study finite-temperature effects. The typical volume of the space of interactions is calculated for strongly-diluted networks as a function of the storage ratio α, temperature T , and the tolerance parameter m, from which the optimal storage capacity α c is obtained as a function of T and m. At zero temperature...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Networks
سال: 1997
ISSN: 0893-6080
DOI: 10.1016/s0893-6080(97)00017-8